Predictive Approaches for Acute Dialysis Requirement and Death in COVID-19.

BACKGROUND AND OBJECTIVES: AKI treated with dialysis initiation is a common complication of coronavirus disease 2019 (COVID-19) among hospitalized patients. However, dialysis supplies and personnel are often limited. DESIGN, SETTING, PARTICIPANTS, & MEASUREMENTS: Using data from adult patients hospitalized with COVID-19 from five hospitals from the Mount Sinai Health System who were admitted between March 10 and December 26, 2020, we developed and validated several models (logistic regression, Least Absolute Shrinkage and Selection Operator (LASSO), random forest, and eXtreme GradientBoosting [XGBoost; with and without imputation]) for predicting treatment with dialysis or death at various time horizons (1, 3, 5, and 7 days) after hospital admission. Patients admitted to the Mount Sinai Hospital were used for internal validation, whereas the other hospitals formed part of the external validation cohort. Features included demographics, comorbidities, and laboratory and vital signs within 12 hours of hospital admission. RESULTS: A total of 6093 patients (2442 in training and 3651 in external validation) were included in the final cohort. Of the different modeling approaches used, XGBoost without imputation had the highest area under the receiver operating characteristic (AUROC) curve on internal validation (range of 0.93-0.98) and area under the precision-recall curve (AUPRC; range of 0.78-0.82) for all time points. XGBoost without imputation also had the highest test parameters on external validation (AUROC range of 0.85-0.87, and AUPRC range of 0.27-0.54) across all time windows. XGBoost without imputation outperformed all models with higher precision and recall (mean difference in AUROC of 0.04; mean difference in AUPRC of 0.15). Features of creatinine, BUN, and red cell distribution width were major drivers of the model's prediction. CONCLUSIONS: An XGBoost model without imputation for prediction of a composite outcome of either death or dialysis in patients positive for COVID-19 had the best performance, as compared with standard and other machine learning models. PODCAST: This article contains a podcast at https://www.asn-online.org/media/podcast/CJASN/2021_07_09_CJN17311120.mp3.

Evaluation of a machine learning approach utilizing wearable data for prediction of SARS-CoV-2 infection in healthcare workers.

Objective: To determine whether a machine learning model can detect SARS-CoV-2 infection from physiological metrics collected from wearable devices. Materials and Methods: Health care workers from 7 hospitals were enrolled and prospectively followed in a multicenter observational study. Subjects downloaded a custom smart phone app and wore Apple Watches for the duration of the study period. Daily surveys related to symptoms and the diagnosis of Coronavirus Disease 2019 were answered in the app. Results: We enrolled 407 participants with 49 (12%) having a positive nasal SARS-CoV-2 polymerase chain reaction test during follow-up. We examined 5 machine-learning approaches and found that gradient-boosting machines (GBM) had the most favorable validation performance. Across all testing sets, our GBM model predicted SARS-CoV-2 infection with an average area under the receiver operating characteristic (auROC) = 86.4% (confidence interval [CI] 84-89%). The model was calibrated to value sensitivity over specificity, achieving an average sensitivity of 82% (CI ±âˆ¼4%) and specificity of 77% (CI ±âˆ¼1%). The most important predictors included parameters describing the circadian heart rate variability mean (MESOR) and peak-timing (acrophase), and age. Discussion: We show that a tree-based ML algorithm applied to physiological metrics passively collected from a wearable device can identify and predict SARS-CoV-2 infection. Conclusion: Applying machine learning models to the passively collected physiological metrics from wearable devices may improve SARS-CoV-2 screening methods and infection tracking.

COVID-19 in German Competitive Sports: Protocol for a Prospective Multicenter Cohort Study (CoSmo-S).

Objective: It is unclear whether and to what extent COVID-19 infection poses health risks and a chronic impairment of performance in athletes. Identification of individual health risk is an important decision-making basis for managing the pandemic risk of infection with SARS-CoV-2 in sports and return to play (RTP). Methods: This study aims 1) to analyze the longitudinal rate of seroprevalence of SARS-CoV-2 in German athletes, 2) to assess health-related consequences in athletes infected with SARS-CoV-2, and 3) to reveal effects of the COVID-19 pandemic in general and of a cleared SARS-CoV-2 infection on exercise performance. CoSmo-S is a prospective observational multicenter study establishing two cohorts: 1) athletes diagnosed positive for COVID-19 (cohort 1) and 2) federal squad athletes who perform their annual sports medical preparticipation screening (cohort 2). Comprehensive diagnostics including physical examination, laboratory blood analyses and blood biobanking, resting and exercise electrocardiogram (ECG), echocardiography, spirometry and exercise testing added by questionnaires are conducted at baseline and follow-up. Results and Conclusion: We expect that the results obtained, will allow us to formulate recommendations regarding RTP on a more evidence-based level.

COVID-19 in German Competitive Sports: Protocol for a Prospective Multicenter Cohort Study (CoSmo-S)

Objective: It is unclear whether and to what extent COVID-19 infection poses health risks and a chronic impairment of performance in athletes. Identification of individual health risk is an important decision-making basis for managing the pandemic risk of infection with SARS-CoV-2 in sports and return to play (RTP). Methods: This study aims 1) to analyze the longitudinal rate of seroprevalence of SARS-CoV-2 in German athletes, 2) to assess health-related consequences in athletes infected with SARS-CoV-2, and 3) to reveal effects of the COVID-19 pandemic in general and of a cleared SARS-CoV-2 infection on exercise performance. CoSmo-S is a prospective observational multicenter study establishing two cohorts: 1) athletes diagnosed positive for COVID-19 (cohort 1) and 2) federal squad athletes who perform their annual sports medical preparticipation screening (cohort 2). Comprehensive diagnostics including physical examination, laboratory blood analyses and blood biobanking, resting and exercise electrocardiogram (ECG), echocardiography, spirometry and exercise testing added by questionnaires are conducted at baseline and follow-up. Results and Conclusion: We expect that the results obtained, will allow us to formulate recommendations regarding RTP on a more evidence-based level.

Use of Physiological Data From a Wearable Device to Identify SARS-CoV-2 Infection and Symptoms and Predict COVID-19 Diagnosis: Observational Study.

BACKGROUND: Changes in autonomic nervous system function, characterized by heart rate variability (HRV), have been associated with infection and observed prior to its clinical identification. OBJECTIVE: We performed an evaluation of HRV collected by a wearable device to identify and predict COVID-19 and its related symptoms. METHODS: Health care workers in the Mount Sinai Health System were prospectively followed in an ongoing observational study using the custom Warrior Watch Study app, which was downloaded to their smartphones. Participants wore an Apple Watch for the duration of the study, measuring HRV throughout the follow-up period. Surveys assessing infection and symptom-related questions were obtained daily. RESULTS: Using a mixed-effect cosinor model, the mean amplitude of the circadian pattern of the standard deviation of the interbeat interval of normal sinus beats (SDNN), an HRV metric, differed between subjects with and without COVID-19 (P=.006). The mean amplitude of this circadian pattern differed between individuals during the 7 days before and the 7 days after a COVID-19 diagnosis compared to this metric during uninfected time periods (P=.01). Significant changes in the mean and amplitude of the circadian pattern of the SDNN was observed between the first day of reporting a COVID-19-related symptom compared to all other symptom-free days (P=.01). CONCLUSIONS: Longitudinally collected HRV metrics from a commonly worn commercial wearable device (Apple Watch) can predict the diagnosis of COVID-19 and identify COVID-19-related symptoms. Prior to the diagnosis of COVID-19 by nasal swab polymerase chain reaction testing, significant changes in HRV were observed, demonstrating the predictive ability of this metric to identify COVID-19 infection.

Factors Associated With Longitudinal Psychological and Physiological Stress in Health Care Workers During the COVID-19 Pandemic: Observational Study Using Apple Watch Data.

BACKGROUND: The COVID-19 pandemic has resulted in a high degree of psychological distress among health care workers (HCWs). There is a need to characterize which HCWs are at an increased risk of developing psychological effects from the pandemic. Given the differences in the response of individuals to stress, an analysis of both the perceived and physiological consequences of stressors can provide a comprehensive evaluation of its impact. OBJECTIVE: This study aimed to determine characteristics associated with longitudinal perceived stress in HCWs and to assess whether changes in heart rate variability (HRV), a marker of autonomic nervous system function, are associated with features protective against longitudinal stress. METHODS: HCWs across 7 hospitals in New York City, NY, were prospectively followed in an ongoing observational digital study using the custom Warrior Watch Study app. Participants wore an Apple Watch for the duration of the study to measure HRV throughout the follow-up period. Surveys measuring perceived stress, resilience, emotional support, quality of life, and optimism were collected at baseline and longitudinally. RESULTS: A total of 361 participants (mean age 36.8, SD 10.1 years; female: n=246, 69.3%) were enrolled. Multivariate analysis found New York City's COVID-19 case count to be associated with increased longitudinal stress (P=.008). Baseline emotional support, quality of life, and resilience were associated with decreased longitudinal stress (P<.001). A significant reduction in stress during the 4-week period after COVID-19 diagnosis was observed in the highest tertial of emotional support (P=.03) and resilience (P=.006). Participants in the highest tertial of baseline emotional support and resilience had a significantly different circadian pattern of longitudinally collected HRV compared to subjects in the low or medium tertial. CONCLUSIONS: High resilience, emotional support, and quality of life place HCWs at reduced risk of longitudinal perceived stress and have a distinct physiological stress profile. Our findings support the use of these characteristics to identify HCWs at risk of the psychological and physiological stress effects of the pandemic.

A Resilience-Building App to Support the Mental Health of Health Care Workers in the COVID-19 Era: Design Process, Distribution, and Evaluation.

BACKGROUND: The COVID-19 pandemic has resulted in increased strain on health care systems and negative psychological effects on health care workers (HCWs). This is anticipated to result in long-term negative mental health effects on the population, with HCWs representing a particularly vulnerable group. The scope of the COVID-19 pandemic necessitates the development of a scalable mental health platform to provide services to large numbers of at-risk or affected individuals. The Mount Sinai Health System in New York City was at the epicenter of the pandemic in the United States. OBJECTIVE: The Center for Stress, Resilience, and Personal Growth (CSRPG) was created to address the current and anticipated psychological impact of the pandemic on the HCWs in the health system. The mission of the Center is to support the resilience and mental health of employees through educational offerings, outreach, and clinical care. Our aim was to build a mobile app to support the newly founded Center in its mission. METHODS: We built the app as a standalone digital platform that hosts a suite of tools that users can interact with on a daily basis. With consideration for the Center's aims, we determined the overall vision, initiatives, and goals for the Wellness Hub app, followed by specific milestone tasks and deliverables for development. We defined the app's primary features based on the mental health assessment and needs of HCWs. Feature definition was informed by the results of a resilience survey widely distributed to Mount Sinai HCWs and by the resources offered at CSRPG, including workshop content. RESULTS: We launched our app over the course of two phases, the first phase being a "soft" launch and the second being a broader launch to all of Mount Sinai. Of the 231 HCWs who downloaded the app, 173 (74.9%) completed our baseline assessment of all mental health screeners in the app. Results from the baseline assessment show that more than half of the users demonstrate a need for support in at least one psychological area. As of 3 months after the Phase 2 launch, approximately 55% of users re-entered the app after their first opening to explore additional features, with an average of 4 app openings per person. CONCLUSIONS: To address the mental health needs of HCWs during the COVID-19 pandemic, the Wellness Hub app was built and deployed throughout the Mount Sinai Health System. To our knowledge, this is the first resilience app of its kind. The Wellness Hub app is a promising proof of concept, with room to grow, for those who wish to build a secure mobile health app to support their employees, communities, or others in managing and improving mental and physical well-being. It is a novel tool offering mental health support broadly.

AKI in Hospitalized Patients with COVID-19.

BACKGROUND: Early reports indicate that AKI is common among patients with coronavirus disease 2019 (COVID-19) and associated with worse outcomes. However, AKI among hospitalized patients with COVID-19 in the United States is not well described. METHODS: This retrospective, observational study involved a review of data from electronic health records of patients aged ≥18 years with laboratory-confirmed COVID-19 admitted to the Mount Sinai Health System from February 27 to May 30, 2020. We describe the frequency of AKI and dialysis requirement, AKI recovery, and adjusted odds ratios (aORs) with mortality. RESULTS: Of 3993 hospitalized patients with COVID-19, AKI occurred in 1835 (46%) patients; 347 (19%) of the patients with AKI required dialysis. The proportions with stages 1, 2, or 3 AKI were 39%, 19%, and 42%, respectively. A total of 976 (24%) patients were admitted to intensive care, and 745 (76%) experienced AKI. Of the 435 patients with AKI and urine studies, 84% had proteinuria, 81% had hematuria, and 60% had leukocyturia. Independent predictors of severe AKI were CKD, men, and higher serum potassium at admission. In-hospital mortality was 50% among patients with AKI versus 8% among those without AKI (aOR, 9.2; 95% confidence interval, 7.5 to 11.3). Of survivors with AKI who were discharged, 35% had not recovered to baseline kidney function by the time of discharge. An additional 28 of 77 (36%) patients who had not recovered kidney function at discharge did so on posthospital follow-up. CONCLUSIONS: AKI is common among patients hospitalized with COVID-19 and is associated with high mortality. Of all patients with AKI, only 30% survived with recovery of kidney function by the time of discharge.

Federated Learning of Electronic Health Records to Improve Mortality Prediction in Hospitalized Patients With COVID-19: Machine Learning Approach.

BACKGROUND: Machine learning models require large datasets that may be siloed across different health care institutions. Machine learning studies that focus on COVID-19 have been limited to single-hospital data, which limits model generalizability. OBJECTIVE: We aimed to use federated learning, a machine learning technique that avoids locally aggregating raw clinical data across multiple institutions, to predict mortality in hospitalized patients with COVID-19 within 7 days. METHODS: Patient data were collected from the electronic health records of 5 hospitals within the Mount Sinai Health System. Logistic regression with L1 regularization/least absolute shrinkage and selection operator (LASSO) and multilayer perceptron (MLP) models were trained by using local data at each site. We developed a pooled model with combined data from all 5 sites, and a federated model that only shared parameters with a central aggregator. RESULTS: The LASSOfederated model outperformed the LASSOlocal model at 3 hospitals, and the MLPfederated model performed better than the MLPlocal model at all 5 hospitals, as determined by the area under the receiver operating characteristic curve. The LASSOpooled model outperformed the LASSOfederated model at all hospitals, and the MLPfederated model outperformed the MLPpooled model at 2 hospitals. CONCLUSIONS: The federated learning of COVID-19 electronic health record data shows promise in developing robust predictive models without compromising patient privacy.

Coronavirus 2019 and People Living With Human Immunodeficiency Virus: Outcomes for Hospitalized Patients in New York City.

BACKGROUND: There are limited data regarding the clinical impact of coronavirus disease 2019 (COVID-19) on people living with human immunodeficiency virus (PLWH). In this study, we compared outcomes for PLWH with COVID-19 to a matched comparison group. METHODS: We identified 88 PLWH hospitalized with laboratory-confirmed COVID-19 in our hospital system in New York City between 12 March and 23 April 2020. We collected data on baseline clinical characteristics, laboratory values, HIV status, treatment, and outcomes from this group and matched comparators (1 PLWH to up to 5 patients by age, sex, race/ethnicity, and calendar week of infection). We compared clinical characteristics and outcomes (death, mechanical ventilation, hospital discharge) for these groups, as well as cumulative incidence of death by HIV status. RESULTS: Patients did not differ significantly by HIV status by age, sex, or race/ethnicity due to the matching algorithm. PLWH hospitalized with COVID-19 had high proportions of HIV virologic control on antiretroviral therapy. PLWH had greater proportions of smoking (P < .001) and comorbid illness than uninfected comparators. There was no difference in COVID-19 severity on admission by HIV status (P = .15). Poor outcomes for hospitalized PLWH were frequent but similar to proportions in comparators; 18% required mechanical ventilation and 21% died during follow-up (compared with 23% and 20%, respectively). There was similar cumulative incidence of death over time by HIV status (P = .94). CONCLUSIONS: We found no differences in adverse outcomes associated with HIV infection for hospitalized COVID-19 patients compared with a demographically similar patient group.

Machine Learning to Predict Mortality and Critical Events in a Cohort of Patients With COVID-19 in New York City: Model Development and Validation.

BACKGROUND: COVID-19 has infected millions of people worldwide and is responsible for several hundred thousand fatalities. The COVID-19 pandemic has necessitated thoughtful resource allocation and early identification of high-risk patients. However, effective methods to meet these needs are lacking. OBJECTIVE: The aims of this study were to analyze the electronic health records (EHRs) of patients who tested positive for COVID-19 and were admitted to hospitals in the Mount Sinai Health System in New York City; to develop machine learning models for making predictions about the hospital course of the patients over clinically meaningful time horizons based on patient characteristics at admission; and to assess the performance of these models at multiple hospitals and time points. METHODS: We used Extreme Gradient Boosting (XGBoost) and baseline comparator models to predict in-hospital mortality and critical events at time windows of 3, 5, 7, and 10 days from admission. Our study population included harmonized EHR data from five hospitals in New York City for 4098 COVID-19-positive patients admitted from March 15 to May 22, 2020. The models were first trained on patients from a single hospital (n=1514) before or on May 1, externally validated on patients from four other hospitals (n=2201) before or on May 1, and prospectively validated on all patients after May 1 (n=383). Finally, we established model interpretability to identify and rank variables that drive model predictions. RESULTS: Upon cross-validation, the XGBoost classifier outperformed baseline models, with an area under the receiver operating characteristic curve (AUC-ROC) for mortality of 0.89 at 3 days, 0.85 at 5 and 7 days, and 0.84 at 10 days. XGBoost also performed well for critical event prediction, with an AUC-ROC of 0.80 at 3 days, 0.79 at 5 days, 0.80 at 7 days, and 0.81 at 10 days. In external validation, XGBoost achieved an AUC-ROC of 0.88 at 3 days, 0.86 at 5 days, 0.86 at 7 days, and 0.84 at 10 days for mortality prediction. Similarly, the unimputed XGBoost model achieved an AUC-ROC of 0.78 at 3 days, 0.79 at 5 days, 0.80 at 7 days, and 0.81 at 10 days. Trends in performance on prospective validation sets were similar. At 7 days, acute kidney injury on admission, elevated LDH, tachypnea, and hyperglycemia were the strongest drivers of critical event prediction, while higher age, anion gap, and C-reactive protein were the strongest drivers of mortality prediction. CONCLUSIONS: We externally and prospectively trained and validated machine learning models for mortality and critical events for patients with COVID-19 at different time horizons. These models identified at-risk patients and uncovered underlying relationships that predicted outcomes.

Retrospective cohort study of clinical characteristics of 2199 hospitalised patients with COVID-19 in New York City.

OBJECTIVE: The COVID-19 pandemic is a global public health crisis, with over 33 million cases and 999 000 deaths worldwide. Data are needed regarding the clinical course of hospitalised patients, particularly in the USA. We aimed to compare clinical characteristic of patients with COVID-19 who had in-hospital mortality with those who were discharged alive. DESIGN: Demographic, clinical and outcomes data for patients admitted to five Mount Sinai Health System hospitals with confirmed COVID-19 between 27 February and 2 April 2020 were identified through institutional electronic health records. We performed a retrospective comparative analysis of patients who had in-hospital mortality or were discharged alive. SETTING: All patients were admitted to the Mount Sinai Health System, a large quaternary care urban hospital system. PARTICIPANTS: Participants over the age of 18 years were included. PRIMARY OUTCOMES: We investigated in-hospital mortality during the study period. RESULTS: A total of 2199 patients with COVID-19 were hospitalised during the study period. As of 2 April, 1121 (51%) patients remained hospitalised, and 1078 (49%) completed their hospital course. Of the latter, the overall mortality was 29%, and 36% required intensive care. The median age was 65 years overall and 75 years in those who died. Pre-existing conditions were present in 65% of those who died and 46% of those discharged. In those who died, the admission median lymphocyte percentage was 11.7%, D-dimer was 2.4 µg/mL, C reactive protein was 162 mg/L and procalcitonin was 0.44 ng/mL. In those discharged, the admission median lymphocyte percentage was 16.6%, D-dimer was 0.93 µg/mL, C reactive protein was 79 mg/L and procalcitonin was 0.09 ng/mL. CONCLUSIONS: In our cohort of hospitalised patients, requirement of intensive care and mortality were high. Patients who died typically had more pre-existing conditions and greater perturbations in inflammatory markers as compared with those who were discharged.

Characterization of Patients Who Return to Hospital Following Discharge from Hospitalization for COVID-19.

BACKGROUND: Data on patients with coronavirus disease 2019 (COVID-19) who return to hospital after discharge are scarce. Characterization of these patients may inform post-hospitalization care. OBJECTIVE: To describe clinical characteristics of patients with COVID-19 who returned to the emergency department (ED) or required readmission within 14 days of discharge. DESIGN: Retrospective cohort study of SARS-COV-2-positive patients with index hospitalization between February 27 and April 12, 2020, with ≥ 14-day follow-up. Significance was defined as P < 0.05 after multiplying P by 125 study-wide comparisons. PARTICIPANTS: Hospitalized patients with confirmed SARS-CoV-2 discharged alive from five New York City hospitals. MAIN MEASURES: Readmission or return to ED following discharge. RESULTS: Of 2864 discharged patients, 103 (3.6%) returned for emergency care after a median of 4.5 days, with 56 requiring inpatient readmission. The most common reason for return was respiratory distress (50%). Compared with patients who did not return, there were higher proportions of COPD (6.8% vs 2.9%) and hypertension (36% vs 22.1%) among those who returned. Patients who returned also had a shorter median length of stay (LOS) during index hospitalization (4.5 [2.9,9.1] vs 6.7 [3.5, 11.5] days; Padjusted = 0.006), and were less likely to have required intensive care on index hospitalization (5.8% vs 19%; Padjusted = 0.001). A trend towards association between absence of in-hospital treatment-dose anticoagulation on index admission and return to hospital was also observed (20.9% vs 30.9%, Padjusted = 0.06). On readmission, rates of intensive care and death were 5.8% and 3.6%, respectively. CONCLUSIONS: Return to hospital after admission for COVID-19 was infrequent within 14 days of discharge. The most common cause for return was respiratory distress. Patients who returned more likely had COPD and hypertension, shorter LOS on index-hospitalization, and lower rates of in-hospital treatment-dose anticoagulation. Future studies should focus on whether these comorbid conditions, longer LOS, and anticoagulation are associated with reduced readmissions.